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ABSTRACT 

This paper explores the emergence of selective admission policies in Dutch university education. Such policies are 
being developed to promote excellence in a higher education system that is generally known to be "egalitarian” and 
increasingly criticized for a lack of differentiation. The changing policy context of admission in Dutch university 
education and its driving forces and rationales are discussed in the context of European-wide developments such as 
the Bologna Process. Especially the emergence of selective liberal arts colleges will be presented as a recent 
excellence initiative. A review of international trends, methods and criteria in selective admission (notably from 
systems with extensive experience in this field such as the USA), including historical pitfalls, provides an analytical 
framework for the discussion of the fostering of excellence in combination with the aim for diversity in the student 
population. The predictive value of selection methods and criteria used at Amsterdam University College (AUC) are 
evaluated against the study progress and performance of AUC students. This includes academic criteria such as 
GPA in secondary school, and AUC’s use of interviews. Examining data from AUC’s first entering class in 2009, the 
college has achieved enrolling students from different national and socioeconomic backgrounds. It is also achieving 
excellence in terms of study progress and academic performance, including an attrition rate of only 13 percent. The 
question is whether interviews generate sufficient added value, in particular with regard to the time and costs of this 
model and with a view to the risk of subjective interpretations of “soft variables” such as student motivation. The 
answer seems to be that interviews provide extra guidance to both the student and the institution as to whether the 
student is choosing the right study programme (and not so much as whether he or she is able to complete it 
successfully). Consequently, the combined model of selection on the basis of prior academic achievement at 
secondary school (GPA) and personal interviews will be continued. However, specific attention needs to be paid to 
the fact that the interviewer’s estimate of academic performance seems to be less accurate to predict study success 
than the actual secondary school GPA (i.e. based on the former more students could have been wrongly rejected 
than on the basis of the latter). 



INTRODUCTION 

Dutch Higher Education has a reputation as being extremely egalitarian. There are two reasons for this perception. 
One, access to higher education is in principle open to all students who have the right type of secondary education 
qualification, without any further selection upon admission to higher education institutions, such as entrance 
examinations or the like. Only a few programmes are exceptions to this principle (e.g. schools for fine and performing 
arts, medical schools, and more recently the liberal arts colleges). 

And two, the Dutch universities come out rather equally in global rankings on the basis of (mainly) their research 
performance. Almost all of them score in the top 200 of the world, but none in the top 20. This is metaphorically 
identified as a “plain without peaks” and blamed for falling short in generating excellence and (thus) a sufficient 
degree of competitiveness in the international context. At the same time, it is said that the principle of equity in the 
approach to access to higher education does not lead to actual equality of opportunity. 

As the tertiary level builds on an educational system with early tracking (at age 12) it creates abundant opportunities 
for those who have the right preparation, are the right age, and the right kind of family situation. But potential 
students from underserved groups who lack necessary language skills, educational preparation, or have family 
members to support them, have more difficulty entering the system (OECD, 2008) The identification of the shortfall in 
the capacity of the system to generate both excellence and diversity at the same time has recently led to new policy 
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initiatives of mostly an experimental nature and even to a more general call to further differentiate the higher 
education system as a whole, which will be discussed in more detail below. 

THE CHANGING POLICY CONTEXT 

The Dutch higher education system has a binary structure, consisting of (13) research universities and (some 40) 
universities of applied sciences. As indicated above, admission to both types of institutions is in principle open to 
students with the right type of secondary qualification, i.e. VWO (university preparatory education, 6 years) for 
universities and HA VO (senior general secondary education, 5 years) for universities of applied sciences. This paper 
will concentrate in particular on the recent changes in the university sector. Since the late 1990s several initiatives 
were taken more or less in parallel towards developing more excellence including the use of selective admission 
methods. The first one was enforced by applicants protesting against the lottery-based admission to medical 
programmes with limited access (numerus fixus, i.e. one of the exceptions to open access). The three-fold rejection 
of a highly talented student made the case for the acceptance by the Ministry of Education of partial use (for 50% of 
applications) of selective admission on the basis of prior academic performance (mainly high school grades) and 
motivation of the candidates. More recently it was decided that this method will soon be applied to all applicants and 
the lottery system will be abandoned completely. 

The second is the implementation of honours programmes in universities. Well-performing students are encouraged 
to engage in extra courses adding on average 30 credits to the 180 credits of the three-year bachelor programme 
(but without extending the duration of the bachelor). They are admitted to the honours programmes on the basis of a 
selection procedure taking their study results in the first year (or semester) and their motivation into account. 

Third is the emergence of “university colleges” which are best understood as liberal arts colleges in US terms (see 
next section). They apply selective admission policies and their students achieve far-above average study results 
(i.e. some 85% of all students who started the programme complete the bachelor programme in three years against 
only some 45% after four years in the university sector in general - excluding students who dropped out in the first 
year). 

The various excellence initiatives described above were all taken by the universities in a rather bottom-up fashion 
and were later followed by (provisional) regulation and eventually by (a proposed) adjustment of legislation. A 
national committee (Commissie Ruim Baan voor Talent) was established in 2003 to advise the Minister on the 
development of excellence and to monitor a small number of experiments with selective admission. In its final 2007 
report, committee recommended further differentiation of type and level of study programmes, but they were rather 
reserved in their recommendations regarding selective admission. This would only apply to study programmes with a 
very specific profile, although the potential positive effect of selection on motivation of student and their study results 
was not denied. The possibility for selective admission on an experimental basis for which institutions have to apply 
for each individual programme concerned was continued. 

In 2008, the Sirius programme for the development of excellence in higher education with an initial budget of 50 M€ 
was created by the Ministry. Virtually all institutions applied for funding to initiate or extend their honours programmes 
(or other excellence tracks) and in two cases to create new liberal arts colleges. In the same year the university 
sector committed itself through an agreement with the Ministry to enrol 10% of students in excellence programmes 
by 2014. In 2009 the Minister stated that the differentiation of the Dutch higher education system had now to be 
taken at hand seriously, while referring explicitly to the Californian ModeR as an example. 

An international advisory committee (the Commissie Veerman, including the former chancellor of the University of 
California) was established. It reported in 2010 that, indeed, the Dutch higher education system needed to be 
differentiated further. It advised that in the new constellation all higher education institutions would obtain the right to 
select students upon admission for specific programmes and specific groups of students. A number of conditions 
were formulated: selection should be complementary to the secondary education qualifications which would still be 
the in principle basis for admission, selection should not exclude any student at the system level, and selection 
methods should be evaluated continually. It was also recommended that institutions develop more distinct profiles, 
referring to U-MAP the European classification of higher education institutions^ (Veerman, 2010). 

But at present the regulatory status of selective admission is still experimental. Draft legislation granting the liberal 
arts colleges the right to select their students on a structural basis was postponed by Parliament after the fall of the 
government in early 2010. Discussions within the sector continue to focus on the type of methods and criteria that 
should be applied (academic achievement versus softer criteria such as motivation) and on whether the best moment 
for selection is upon admission to the first year or at a later point, e.g. during or at the end of the first year. A possible 
combination with the introduction of differential fees for excellence programmes also remains a complicating factor. 
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The question now is whether after a decade of mainiy discussion and oniy iimited experimentation with seiective 
admission the situation wiii be changed more profoundiy. The Veerman report was embraced by aii higher education 
stakehoiders upon pubiication and the new government (to be estabiished after eiections in June 2010) wiii be 
advised to impiement it comprehensiveiy. Whether or not this wiii actuaiiy iead to more comprehensive approaches 
to seiective admission wiii not oniy depend on the poiiticai orientations of the new government. 

Since the Veerman report remained rather vague on the factuai impiementation of seiection, various concepts wiii 
need to be worked out much more concreteiy, which may resuit in iengthy procedures. At the same time, it may be 
expected that the bottom-up initiated experiments and practices with seiective admission wiii continue to deveiop and 
the pubiic opinion wiii shape itseif around the resuits thereof, creating a dynamic driving the further poiicy 
deveiopment. 

And even if the Dutch higher education system wouid in this respect overcome its perceived “egaiitarian” character, 
this wouid oniy be of a partiai nature. Exceiience may now become a more accepted notion, but the reiationship with 
diversity is stiii not conceptuaiised. Nationai poiicies targeting to increase the participation of minority students in 
universities are just nascent so far. Oniy a few institutions have deveioped admissions practices and an enroiied 
student profiie focused on both exceiience and diversity (notabiy Amsterdam University Coiiege (see beiow) and the 
VU University Amsterdam to some extent). 

EXCELLENCE INITIATIVES: FOCUS ON THE EMERGENCE OF LIBERAL ARTS COLLEGES 

The emergence of liberal arts colleges within the Dutch higher education, provides an opportunity to analyze the role 
of selective admissions within the broader framework of European-wide trends in higher education. Liberal arts 
colleges'* are a typical feature of US higher education. However, the liberal arts tradition has its origins with the great 
Greek philosophers and constituted the basis of the medieval university in Europe (Glyder & Weeks, 1998; 
Nussbaum, 2002; Rothblatt, 2003). 

The curriculum of the early European universities was organized around the seven liberal arts, which were divided 
into the Trivium (literary arts: grammar, logic, and rhetoric) and the Quadrivium (mathematical arts: arithmetic, 
geometry, music, and astronomy). This initial part of university education formed the basis for further training at 
advanced level in the main professions of that time, such as medicine, law, and theology. At the same time, it should 
be recognized that the liberal arts model is not part of the mainstream model of higher education anywhere in Europe 
and it has clearly lost the scope that it continued to have in the USA. But since the 1990s various liberal arts colleges 
have been established in Europe. 

A recent overview and comparative analysis (Van der Wende, forthcoming) shows that at least 25 new initiatives 
were taken with models ranging from a separate, usually residential, college (though in many cases associated with 
a larger university) to that of a college or degree program integrated within the larger university. This (re)emergence 
of liberal education in Europe seems to be a response to the need to differentiate the massified European systems, 
which are characterized by insufficient diversity and flexibility in terms of types of institutions and programs offered to 
an increasingly large and diversified body of students (a criticism expressed by the European Commission and the 
OECD and also recognized by scholars, see for instance Huisman & van Vught, 2009). 

More in particular this seems to be related to two main dimensions of differentiation. The first is the quest for broader 
bachelor programs in order to overcome the disadvantages of too early and over-specialization at undergraduate 
level. Such broader bachelor programs would aim to enhance learning effectiveness and to generate graduates with 
skills relevant for the knowledge economy. 

The second dimension of differentiation is the search for excellence or elite education in massified and overly 
egalitarian systems. As one can speak of an almost total decline of elite or top tier higher education in Europe^, there 
is a need to establish more selective branches of higher education focusing explicitly on excellence. These 
developments coincided largely with the implementation of the Bologna Process, which facilitated these 
developments as it (re-)instituted undergraduate education as an educational phase in its own right. 

Although the scope of the renewed liberal arts initiatives is of course very small on the scale of the European higher 
education landscape as a whole, it is remarkable that around one third of these initiatives are concentrated in the 
Netherlands with its relatively small HE system. Consequently, system-level impact may be expected in this context. 
The Dutch liberal arts colleges are all established as honours colleges of major research universities and therefore 
constitute a new branch of excellence in Dutch higher education. The first initiative was taken by Utrecht University 
when it established University College® Utrecht in 1998, soon followed by University College Maastricht (established 
by Maastricht University) in 2002 and by the Roosevelt Academy in 2004 (also owned by Utrecht University). In 2009 
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the University of Amsterdam and the VU University Amsterdam jointiy estabiished Amsterdam University Coiiege 
(AUC) and Leiden University has opened its university coiiege in September 201 OA 

The emergence of iiberai arts coiieges as a new branch of exceiience in Dutch higher education can by be expiained 
aiong the same iines presented above for Europe in generai, i.e. insufficient differentiation in the massified and 
strongiy egaiitarian system. This was underiined by the OECD (2008) which stated that Dutch higher education 
demonstrates an insufficient ievei of differentiation, that there is not enough top quaiity institutions, that the 
internationai dimension shouid be enhanced in terms of students and academic programs, and that too eariy 
speciaiisation shouid be avoided. 

The university coiieges with their seiective admission poiicies, high internationai profiies (30-60% internationai 
students, Engiish taught) and broad curricuia seem to present an effective response to the weaknesses identified at 
system ievei. This has been increasingiy recognized by various actors and stakehoiders groups and most recentiy by 
the Commissie Veerman (see above) in whose report on the further differentiation of the Dutch higher education 
system, the university coiieges were set as an exampie of good practice. Aiso the fact that iegisiation has been 
prepared to grant university coiieges specific status in the higher education act and that the Association of 
Universities in the Netheriands (VSNU) iaunched a project to disseminate good practice from the university coiieges 
into the mainstream of universities provide evidence of impact at the nationai system ievei. 

SELECTIVE ADMISSION: SOME HISTORY AND PITFALLS 

Although most higher education systems have in principle their own history of selection and consequent exclusion of 
certain groups of students (often women or students of particular race), the USA is a particularly well documented 
case study and a rich source for learning for policy makers charged with the design of new or adjustment of existing 
systems of selection. The lessons learned seem to focus on the complex task of balancing the competing demands 
of fostering excellence and guaranteeing broad educational access, especially when recognizing the educational and 
social values of diversity in the student body. 

Private colleges and universities in America where the first to broaden their admission policies which had hitherto 
been based solely on criteria of academic performance and experiment with non-academic performance criteria to 
help select and, in effect, exclude unwanted students - in particular students from lower economic classes, often 
from racial and ethnic groups, such as Jews and Catholic Irish. Beginning with Columbia and spreading to other of 
the Ivy League colleges such as Harvard, Princeton and Yale, these institutions developed culturally biased 
examinations and required students to provide personal information and even photographs to help control their 
enrollments. As explained in Jerome Karabel's book on admissions practices among Ivy League institutions, 
university officials wished to regain control over the composition of the freshmen class, including if necessary the less 
talented sons of major donors. Central criteria in the new policy were more intangible and highly subjective criteria 
such as “character”, “personality” and “leadership” (also including the person’s extracurricular activities) and allowed 
the universities basically to accept and reject whomever they desired. 

This shift from objective academic criteria to subjective non-academic criteria was part of a broader redefinition of 
“merit”. And although the consensus in the US has always been that merit and not inherited privilege should 
determine the distribution of educational opportunity, there has been no consensus on what merit is. Or rather, as 
Karabel states, there is no neutral definition of it and it will thus always benefit some groups while disadvantaging 
others. 

Beginning in the 1950's, with criticism of exclusionary practices by mostly private institutions, and accelerated by the 
spectacular event of Sputnik which fuelled concerns over international competition for talent (institutions of equal 
reputation, such as the French Grandes Ecoles and Tokio University still admitted students purely on academic 
merit), private institutions elevated academic criteria in the selection process. At the same time, selective public 
institutions began to incorporate more non-academic criteria and develop “outreach” programs to students in high 
schools, to help broaden their applicant pool and make their enrolled student populations more broadly 
representative of society. 

The 1960s represented the development of a general consensus among selective institutions, both private and 
public, that academic criteria formed a minimum requirement for admitting students that, combined with a broad 
range of other factors including socio-economic background and talents, helped institutions select a diverse and 
excellent group of students each year. The principle of student body diversity being recognized as of general interest 
for society. To help achieve this goal, most universities also have incorporated “alternative” admission criteria in 
which special circumstances and talents of student can be recognized and used to admit them. 



CSHE Research & Occasional Paper Series 




REUMER AND VAN DER WENDE: Excellence and Diversity 



5 



The University of Caiifornia's nine campuses with undergraduate programs provides evidence of an abiiity to achieve 
these two goais. Admission standards are set to identify taiented students who have a reasonabie to very high 
chance of academic success at the university, and who wiii take advantage of the opportunities afforded to them at 
the institution. 

Recent surveys showed that the undergraduate student body of the University of Caiifornia is indeed very diverse. 
Some 55% of the students have at ieast one parent who was an immigrant. At the UCLA and Berkeiey campuses, 
the most prestigious of the UC system this figure was even 65%. And about 25% of the students are from iow income 
famiiies or first generation students (Dougiass, 2007). Student graduation rates at UC are among the highest in the 
nation. Recent studies aiso demonstrate that there is a great deai of interchange among undergraduate students that 
ieads to a better understanding of differences in aii measures examined: weaith, reiigion, race/ethnicity, immigrant 
status, and poiitics (Chatman, 2008). This supports the view that “The experience of arriving on a campus to iive and 
study with ciassmates from a diverse range of backgrounds is essentiai to students' training for this new worid, 
nurturing in them an instinct to reach out instead of ciinging to the comforts of what seems naturai or famiiiar” (ibid, p. 

4). 

The Caiifornian data underiine that exceiience and diversity can be effectiveiy combined. And this is aiso the pursuit 
of many eiite institutions in the US. Changes in admission poiicies paraiiei to the ones discussed above were 
undertaken in many other eiite institutions in the USA (Bowen & Bok, 1998), inciuding extensive efforts to enhance 
diversity for exampie through outreach programmes (see for an interesting exampie from a top iiberai arts coiiege 
Aries, 2008). 

in deveioping admissions standards and practices, seiective pubiic universities are reiativeiy transparent, outiining 
the criteria used and the process of seiection^. However, in private institutions, which do not have the same ievei of 
pubiic accountabiiity, the seiection process, and how admissions officers go about the actuai decision making, is 
iargeiy done in secret. 

How for instance they baiance incentives to reward high academic accompiishment, athietic skiiis, iegacy (parents 
who studied at the same institution)i°, minority status, and the abiiity to pay fuii tuition? (Stevens, 2007). There is aiso 
evidence that despite aii efforts there is stiii a substantiai pooi of iow-income students that have the abiiity to succeed 
in eiite institutions but are not given what it takes by the admission officers on their way into the system (Bowen ef a/, 
2005). And even that in the present “age of diversity” raciai or ethnic stereotypes may piay out in new ways against 
certain appiicants, e.g. discrimination against Asian American appiicants with on average test scores substantiaiiy 
above those for any other group (Goiden, 2006). 

The section above concentrated on the experiences in the USA, which by aii means are not the oniy ones to hoid 
important iessons for Dutch higher education. The widening participation poiicy in the UK has for instance ied to the 
fear that standards wiii drop as a resuit. But aiso here diversity is defended as an educationai vaiue and in the 
interest of society: “We wiii iearn more from those peopie, those ideas, and those phenomena that we do not know, 
than from those we know oniy too weii. We need to pursue this diversity of peopie and ideas to increase the quaiity of 
our core business - which is to iearn. We need, and we wish, to prepare our students to become active and confident 
participants in a muiticuiturai and giobaiised society” (Brink, 2008). The current discussion on exceiience and 
diversity and the seiection system of the Grandes Ecoles in France is very interesting as weii. 

The French minister recentiy insisted that more iow-income and minority students shouid be enroiied by these 
institutions. A fierce debate is going on whether this is better supported by seiection methods that inciude generai 
inteiiectuai and sociai deveiopment (such as the current concours) or rather by pureiy cognitive skiiis tests such as in 
mathematics. This brings us to the important issue of methods and criteria used in seiection and the roie of cuiturai 
capitai therein, which wiii be discussed in the next section. 

SELECTION METHODS AND THE PREDICTIVE VALUE OF CRITERIA 

As stated above, in the Dutch context the discussion on seiective admission focuses on type of methods and criteria 
that shouid be appiied and on whether the best moment for seiection is upon admission to the first year or at a iater 
point, e.g. during or at the end of the first year. 

Seiection is expected to contribute to exceiience, that is to enhance “study success”, i.e. both iearning efficiency and 
effectiveness, expressed in terms of a students’ progress (number of credit points earned per year) and performance 
(the average of grades obtained, GPA). The iikeiihood that seiection of students contributes to promoting exceiience 
in the sense formuiated above and within the Dutch context is supported by nationai research iiterature (see for an 
overview: Veerman, 2010; Cremonini et ai , 2010): 
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• Selection of students enhances their motivation and commitment to study (Korthais, 2007; Warps, 2009); 

• Seiection of students ieads to higher iearning efficiency and iower drop out rates (Dooge 2005; Euriings-Strop 
2009); 

• Seiection ieads to a higher quaiity of the teaching and iearning process (Korthais, 2007). 

internationai research iiterature generaiiy supports these findings. See for instance Bowen ef a/ (2009) who found a 
very strong positive correiation coefficient (0.88) between seiectivity and raw graduation rates across a iarge duster 
of pubiic universities in the USA. When adjusted for differences in both students’ entering characteristics and 
demographic variabies that reiationship is stiii strongiy positive and statisticaiiy significant. Differences in these rates 
between flagship and state universities seem to be reiated to peer effects (going to coiiege with students more iikeiy 
to graduate makes a student more iikeiy to graduate) and the roie of norms or expectations (highiy seiective 
institutions hoid a wideiy shared expectation that essentiaiiy everyone wiii graduate). 

Dutch research iiterature aiso provides some insights into the type of criteria that shouid be used in the seiection 
process. First of aii, a distinction is made between (Drenth, 2004): 

• Seiection based on criteria that can be affected by the candidate him/herseif (the “merit modei”), i.e. seiection on 
the basis of previous educationai achievements measured in terms of a (finai examination) grade point average 
(GPA) or a GPA for certain specific subjects. 

• Seiection based on basicaiiy aii means which may be considered an indication of a reiationship with future 
academic performance (the “efficiency modei”) such as tests, personaiity data, estimates of motivation and 
interest, etc. 

Drenth then indicates that seiection in iine with the merit modei is preferred because past performance is usuaiiy the 
best predictor for comparabie performance iater on. Research aiso shows that student performance in higher 
education is better predicted by finai GPA than by test scores. This was demonstrated in the Netheriands by among 
others De Gruyter (2005, 2006). He ciaims that the predictive vaiue of finai GPA is high enough to be used for 
seiective purposes. Aiso Borieffs (2009) and De Bruijn (2010) argue that there is sufficient evidence that good finai 
GPA is predictive of academic achievement. Drenth aiso states that seiection on this basis generates the required 
commitment and stimuiates motivation, which is absent from seiection based on criteria that appiicants themseives 
can not influence. 

Furthermore, he argues that measuring such things as motivation in the sense of attitude, commitment and 
perseverance on the basis of essays, motivation ietters, or interviews are unreiiabie and shouid not be part of a 
sound seiection process. Moreover the motivation to study is aiso not a stabie feature, but situationai determined. 

These insights are generaiiy substantiated by the internationai research iiterature. Long-term empiricai research in 
the USA shows that cumuiative^^ grade point average in secondary education is a stronger predictor of academic 
achievement in the bacheior phase than scores on standardized tests^^; ‘‘[Cumuiative] high schooi GPA proved the 
best predictor not oniy of freshman grades in coiieges, but aiso of iong-term coiiege outcomes” (Geiser, 2008, p 2). it 
aiso offers fewer disadvantages for candidates from disadvantaged and minority groups: “Admissions criteria that 
emphasize demonstrated achievement over potentiai abiiity are more iikeiy to promote educationai equity” (ibid, p 2) 
(see aiso Dougiass, 2009). it shouid be noted, however, that the predictive vaiue of schooi grades can be influenced 
by differences in ievei between secondary schoois (see for instance Ogg et ai, 2009). 

But this is more iikeiy in education systems such as in the US and the UK, than in the Netheriands, where there is a 
Dutch secondary tiered-system with at every ievei a nationai written exam (see Drenth, 2004). Nevertheiess, a 
growing discrepancy between grades for the schooi-based examinations and the nationai written examination shouid 
be compiied (De Lange & Dronkers, 2006, 2007). What shouid aiso be taken into account is the fact that a system of 
eariy tracking as in the Netheriands (seiection at 12 years based on the CITO test taken at the end of primary schooi) 
can negativeiy influence schooi careers, which is more often the case for students from minority backgrounds 
(OECD, 2008; Terwei, 2006; Werfhorst & Mijs, 2007). 

This may require an “in context” assessment of prior academic achievement for these groups such as described by 
Dougiass (2007, see above) and (Brink, 2008). it couid in this respect for instance be wrong to reject a candidate for 
reasons of repeating a ciass (or ciasses) or for having foiiowed a “stack route”, since this can be the consequence of 
a iow referrai from primary schooi on the basis of the CITO score (which occurs more frequentiy in the case of 
minority students) or of ianguage deficiency in the case of refugee students who entered the education system iater 
and consequentiy iearned the Dutch ianguage iater than their peers. 
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Finally, Drenth's observation concerning the weak validity of selection based on motivation in the sense of attitude, 
commitment and perseverance deserves extra attention. Beyond the problems of weak validity and reliability, this 
relates also to the influence of cultural capital. Bourdieu’s theory of cultural reproduction (1977) seeks to explain the 
link between social class of origin and social class of destination in terms of the impact of cultural capital on 
educational attainment. He argues that cultural capital consists of familiarity with the dominant culture in a society. 
The possession of cultural capital varies with social class, yet the education system assumes the possession of 
cultural capital. This makes it very difficult for lower class pupils to succeed in the education system. 

Bourdieu describes the ways in which the criteria of university examiners reflect the values of the dominant classes, 
and argues that the more vague the demands of the examiners are, the less chance students from the lower classes 
will have of meeting these demands. In other words, the more vague the demands of the gatekeepers are the more 
important the role of cultural knowledge in meeting them (Zimdars et al, 2009). Consequently the extent to which a 
candidate possesses cultural capital is particularly influential in selection systems that are based on or make use of 
“soft indicators”. The example of the use of diffuse admission criteria such as “character”, and “personality” at Ivy 
League institutions in order to solve the “the Jewish problem” (Karabel, 2005) has been discussed before. 

Recent empirical research in the Netherlands on the internationalization in secondary education sheds some 
interesting new light on the issue of social (and cultural) reproduction (Weenink 2008, 2009). Internationalized 
streams (bilingual education or TTO and streams preparing for the international (IB) or European baccalaureates) 
have been established since the 1990s and are strongly on the rise in the Netherlands. They compete for the best 
pupils with the gymnasiums (more classical type elite grammar schools with Latin and Greek) and are particularly 
popular with parents with a strong international orientation -- the new cosmopolitans. It was found that pupils in 
gymnasiums and internationalized streams both obtained the highest test scores (C/TO) and school 
recommendations at primary level, whereas the average test score of pupils attending regular pre-university (VWO^^) 
streams is significantly lower. 

At the same time, the majority of parents of children who attended internationalized streams resembled the parents 
of children at regular pre-university streams, while parents of children who attended gymnasiums had a significantly 
higher class position and educational level. 

Weenink suggests that this indicates a diverging process of social reproduction between an upwardly cosmopolitan 
fraction (“new elite”) and an established fraction of the Dutch upper middle class (“old elite”). The notion of 
expatriates as “global elites” has been related to the populations of international schools and studying for the IB has 
been identified earlier as a strategy for social elites to opt out of the national educational systems. Indeed, the 
number of non-expatriates that send their children to international or IB schools is also in the Netherlands on the rise. 

AUC’S APPROACH TO SELECTIVE ADMISSION 

Amsterdam University College (AUC) is a small-scale international liberal arts and sciences college (three year 
bachelor honours) with an intensive teaching model in a residential setting. The students engage in small 
international classes with personal attention and interaction with lecturers and get support and advice from a 
personal tutor on planning their study programme. 

The AUC liberal arts and sciences programme differs from traditional, single subject, university programmes in that it 
places particular emphasis on integrating insights from different perspectives, focusing on far-reaching themes and 
real-world problems in science and society^'*. Interdisciplinary learning is supported by the development of scientific 
reasoning and strong analytical skills. In addition, students deepen their knowledge by choosing a major in the 
Sciences, Social Sciences or Humanities. In addition to their intellectual skills, students are encouraged to advance 
their personal and social development in the context of the international community of AUC in the multicultural city of 
Amsterdam. As is reflected in its motto, AUC aims to combine “Excellence and Diversity in a Global City”''A 

Based on the scientific and historical insights regarding admission as presented above, AUC has chosen to base its 
selection procedure for admission in particular on criteria related to prior academic performance, i.e. (cumulative) 
GPA, with particular attention to scores for English and Maths, since skills in these subjects are essential to AUC's 
educational concept. This is supplemented with background information about previous school experiences and 
academic performance through school leaving documents^® and letters of recommendation from former teachers. It is 
noted that GPA may under certain circumstances in fact not reflect the actual academic ability of the student. 
Students who feel this is their case are encouraged to explain the reasons for this in their application^T 

Other (softer) factors are taken into account mainly to explore whether the applicant’s motivation to study at AUC 
corresponds to what the program is actually offering. For instance why does the candidate apply for a broad 
(interdisciplinary) and intensive study programme, which themes in the curriculum do appeal to him/her and why? To 
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what extent will his/her expectations with respect to the international environment and campus iife at AUC match with 
what is expected from students in this context. This is especiaiiy important since the iiberai arts modei is reiativeiy 
new in the Dutch context and so are residentiai coiieges. To this end the student provides a motivation ietter and a 
personai essay which are discussed more in detaii during the admission interview. 

As said, these “soft” criteria shouid be considered very carefuiiy. For exampie, “internationai orientation” shouid not 
be confused with “internationai experience”. The student shouid have a genuine interest in participating in an 
internationai community, but this is not necessariiy equai to having undertaken a iot of internationai activities aiready. 
in some sociai circies, trips abroad or “gap years” are more obvious than in others, and for a student who comes 
from an environment that provides fewer such opportunities, studying at AUC couid entaii a great opportunity in this 
respect. 

in this way, AUC seeks to achieve a soiid (high predictive vaiue) and objective (to avoid bias on soft indicators) 
seiection method, institutionai research is in piace to constantiy monitor the vaiidity of the criteria used. Training is 
provided to the assessors to guarantee the best possibie reiiabiiity in the use of the seiection methods and toois. 
Cooperation with secondary schoois (especiaiiy some with high minority popuiations) has been estabiished to 
deveiop methods for “in context” assessment of appiications from students with a-typicai schooi careers. 

The serious caution with respect to the use of “soft indicators” is based on the “iessons iearned” as discussed above, 
which are aii the more important for AUC since its mission is to combine exceiience and diversity. Consequentiy, and 
in paraiiei to the consideration of individuai students on their personai performance and profiie, AUC aiso pays 
attention to the composition of a sociaiiy coherent yet diverse cohort of students. AUC seeks to estabiish an 
academic community that reflects the sociai, cuiturai and economic diversity of our giobaiizing worid and that fosters 
giobai knowiedge and internationai and intercuiturai iearning through ongoing diaiogue among peopie with a variety 
of experiences and iife views. 

AUC therefore aims to put together a student body with a high academic profiie and a mix of sociai, cuiturai and 
economic backgrounds, as the best teaching and iearning environment to foster giobai knowiedge and internationai 
and intercuiturai icarning^A Consequentiy AUC is committed to non-discrimination, and wiii admit students of any 
race, nationai or ethnic origin, coiour, reiigion, age, gender, sexuai orientation, maritai status or physicai disabiiity. To 
heip ensure equaiity of opportunity for aii students, a schoiarship programme is avaiiabie^®. 

AUC currentiy admits a maximum of 200 students per year. Both Dutch and internationai students are weicome to 
appiy. The fact that students thus have different backgrounds in terms of the nationai education system they come 
from raises extra chaiienges for the seiection process in terms of the assessment of their prior and future 
performance. This is done on the basis of current methods for the comparison of academic quaiifications taking into 
consideration the principies of recognition as iaid down in the Lisbon Convention on the Recognition of Quaiifications 
concerning Higher Education in the European Region, as deveioped by the Councii of Europe together with 
UNESCO, which is the key iegai instrument for recognition of quaiifications across Europe. 

The student is in principie eiigibie for admission to AUC if he or she has a secondary schooi dipioma equivaient to 
the Dutch VWO, inciuding the internationai Baccaiaureate. Apart from the secondary schooi dipioma and grade iists, 
the appiicant sends in an appiication essay, a personai statement (ietter of motivation) and recommendations from 
the head of your secondary schooi and (former) teachers. A technicai review is carried out by AUC to assess 
eiigibiiity of the candidate and possibiy for identification of deficiencies. 

The next step entaiis the first reader who assesses the in principie suitabiiity of the candidate by assessing the 
dossier with a focus on: 

• academic exceiience: the abiiity to meet the academic demands of the AUC programme; the grade point 
average (GPA) wiii be used as an indicator of this 

• in particular the level of proficiency in English and mathematics 

• motivation and ambition to study an intensive and broad programme 

• commitment to contribute to AUC's international student and campus life 

On the basis of this assessment students are invited (or not) for a personal interview, which is carried out by one or 
two interviewers (other than the first reader). Prior to the interview, the interviewers take notice of the applicant's 
dossier, including their secondary school grades, recommendation letters, essay and comments of the first reviewer 
of the dossier. The interviewer(s) score their assessment on the following dimensions: 

• Academic Performance 



CSHE Research & Occasional Paper Series 




REUMER AND VAN DER WENDE: Excellence and Diversity 



9 



• Intellectual Curiosity 

• Communication Skiiis 

• Seif-confidence /Maturity 

• Ambition 

• Contribution to the ADC Community 

• Internationai Orientation 

They conciude their report with an estimation of the iikeiihood the appiicant wiii succeed at AUC and a finai advice for 
admission. After the interview the AUC Admissions Committee decides which students shouid be invited to study at 
AUC. These decisions are made in a scenario-based way, ieaving very iittie room for discussion of individuai 
dossiers. 



RESEARCH QUESTIONS 

Institutional research at AUC is aimed at establishing an evidence-based method of selection for admission to 
undergraduate university education, on the base of predictive indicators of study success, with the purpose of 
promoting excellence and diversity. 

It focused on the following questions: 

• How can excellence (study success) in undergraduate university education be predicted? - What are the factors 
that explain most variance in terms of excellence (study success)? 

• To what extent do these processes and factors vary in relation to the diversity of students' background in terms 
of their national education system of origin (secondary school system) and their socio-economic background? 



PRELIMINARY EMPIRICAL FINDINGS 

The research questions stated above have been investigated for the first time on the basis of empirical data gathered 
during the first academic year of the first cohort of students at Amsterdam University College, who have started in 
September 2009 (class of 2012). Obviously, the limitations of such a first measurement should be taken into account 
when generalizing the results (see conclusions and discussion). 

A database was constructed containing all data gathered during the admission process: secondary school grades of 
the applicants, scores on several dimensions assessed during the interview, etc (see previous section). These 
admission variables were compared with the academic results obtained by the students during their first year at AUC 
in order to investigate the relationship between them. A linear model was constructed to yield a predictive model for 
academic results on the basis of the admission variables. The results are presented below. 

First, the cohort is described quantitatively (descriptive statistics). In the following sections the relationships between 
various (sets of) dependent and independent variables is explored. It is noted that since these analyses relate to the 
complete first cohort of AUC (not a sample of it), and no generalizations to other populations are primarily intended, it 
may be subject to debate whether there is a function for inferential statistics, which address the relation between a 
sample and the population it is drawn from. In this study, effects of differences will be expressed primarily in terms of 
effect size (ES), as the main indicator for effects within this population. Secondly and in order to meet common 
practice, statistical tests and according significance levels are presented with the effects of differences and 
correlations. 

BASIC CHARACTERISTICS OF THE AUC STUDENT COHORT 

The basic characteristics of the 189 students who have started in September 2009 are shown in several figures in 
Appendix A^o. The students of this cohort are almost evenly distributed over gender, a slight majority is female (57%). 
Their average age at the start of their studies is 19.5 years, virtually the same for males and females (19.6 and 19.4 
years, respectively). The students come from diverse secondary school backgrounds, the distribution is shown in 
Appendix A, Figure A1 . About half of the students (53%) have a Dutch \/WO background. The second largest group 
(16%) holds an International Baccalaureate, followed by 10% having graduated with the German Abitur. US 
secondary school diploma’s and UK A-levels form only mall groups (4% and 3%, respectively), and will be excluded 
from further analysis here. The remaining group (14%) comprises a broad range of different secondary school 
diploma’s. 

Dutch \/WO (‘Voorbereidend Wetenschappelijk Onderwijs’: University Preparatory Education, see footnote xiii) takes 
six years. About half-way this period, VWO students choose a selection of courses, a so-called course profile. The 
finai exam consists of the chosen profile courses. This is relevant as these profiles include rather different 
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combinations of subjects taken. With their course profiie, the students aiso choose a mathematics profiie and ievei. 
This is reievant since these differ substantiaiiy in terms of the mathematicai skiiis and ievei they are trained at. 

There are four different profiies: NT - Science and Technoiogy, NG - Science and Heaith, EM - Economics and 
Society, CM - Cuiture and Society, and four kinds of mathematics. The NT and NG profiies are sciences-oriented 
subjects, the EM and CM profiies are more associated with sociai sciences and humanities. Maths profiie A has a 
emphasis on Statistics, B on Caicuius; ievei 1,2 (A1,2; B1,2) is more advanced than ievei 1 (A1; B1) Because each 
course profiie demands a specific kind of mathematics, the profiie of mathematics is to a certain extent reiated to 
course profiie: A1 is roughiy associated with CM, A1,2 with EM, B1 with NG and B1,2 with NT. Aithough, students 
may choose a higher ievei of mathematics than minimaiiy demanded, as is reflected in Appendix A, Figures A2a and 
A2b. 

The iargest group, near haif (47%) of the students has stated to prefer Sociai Sciences as a major. About a quarter 
(26%) chose Sciences, 14% Humanities and 13% didn't know yet which major they wouid choose. As is shown in 
Figure A3, gender was aimost equaiiy distributed within each major, with the Sociai Sciences having siightiy more 
maies and Sciences and Humanities having siightiy more femaies. 

Students’ secondary schooi backgrounds reiate in different ways to their preferred majors (see Figure A4). To 
mention the most notabie differences: 

• Reiativeiy many IB students chose Sociai Sciences (61 %) as a major (47% over aii) 

• Reiativeiy many VWO students chose Sciences (33%) and reiativeiy few chose Humanities (9%) 

• German Abitur students chose reiativeiy often for Humanities (28%) and few for Sciences (6%), aithough many 
Abitur students did not know their preferred major at the time of the admission^!. 

The secondary schooi grades of the three iargest secondary schooi groups are dispiayed in Figures A5 a-c. it is not 
simpie to compare secondary schooi grades, since grading scaies and methods differ from one country and system 
to another. Therefore anaiyses of secondary schooi grades are performed within these schooi-type groups. 

INTERVIEW VARIABLES 

The cohort presented above was selected from a larger ( > 400) group of applicants. From them 319 were eventually 
invited for an interview. In these interviews the applicants' abilities were scored on several dimensions, yielding the 
following interview variables22: 

As primary variables: 

• Academic Performance (ACPF) 

• Intellectual Curiosity (/A/CL/) 

• Communication Skills (COSK) 

• Self-confidence /Maturity (SECO) 

• Ambition (AMBI) 

• Contribution to the AUC Community (CONI) 

• International Orientation {INTO) 

As secondary (advisory) variables, based on the primary variables: 

• Likelihood to Succeed {LSUC) 

• Final Advice (FADV) 

All these dimensions are scored on a 3-points scale^^, except for FADV, the interviewer’s final advice for admission, 
which is scored on a 5-points scale. 

The following results concern the interview scores on all recorded interviews, 319 in total (i.e. including the students 
who were offered a place at AUC, as well as those who were not). 

It appears that most interview scores are relatively high (see Figure A6a-b), compared to the scale on which they are 
scored (1-3, except for Final Advice: 1-5). This might suggest a ‘ceiling effect', which means that variance of scores 
is restricted at the highest end of the scale. This is most likely caused by the fact that selection has already taken 
place before the interview. Technical review reveals students that are not eligible and/or have deficiencies and once 
the applicants are invited for the interview, they have already been considered suitable for admission by the first 
reviewer. Of course, when correlating the interview scores with measures of study success, as is addressed later on 
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in this article, the interview scores are expected to be even more restricted to the high end of the scaie, because 
those numbers concern oniy those students who have been admitted. 

There appear to be minor differences of interview scores between some secondary schooi groups (e.g. iB scores 
high on Communication Skiils, VWO scores reiativeiy iow on Internationai Orientation). But aii over the VWO, IB and 
Abitur groups show comparabie scores on most of the interview variabies. 

Table 1. Rank correlations (Spearman’s rho) between the interview scores. 





ACPF 


/A/CL/ 


COSK 


SECO 


AMBI 


CONT 


INTO 


LSUC 


Academic 

Performance 


1.00 
















Intellectual Curiosity 


.46** 


1.00 














Communication 

Skills 


.15** 


.31** 


1.00 












Self-confidence / 
Maturity 


.22** 


.34** 


.40** 


1.00 










Ambition 


.29** 


.40** 


.15** 


.45** 


1.00 








Contribution to AUC 
Community 


.24** 


.34** 


.18** 


.31** 


.30** 


1.00 






International 

Orientation 


.03 


.19** 


.48** 


.32** 


.06 


.34** 


1.00 




Likelihood to 
Succeed 


.52** 


.65** 


.27** 


.42** 


.45** 


.47** 


.28** 


1.00 


Final Advice 


.61** 


.74** 


.40** 


.46** 


.49** 


.45** 


.30** 


.78** 



**. Correlation is significant at the 0.01 level (2-tailed). 

In Table 1 the most striking correiations (rho > .40) have been underiined. it shows that at the ievei of the primary 
variabies moderate correiations seem to exist between: 

• Communication Skills and International Orientation (rho = .48), 

• Academic Performance and Intellectual Curiosity (rho = .46), 

• Self-confidence and Ambition (rho = .45). 

Stronger correiations were found between the secondary (advisory) interview variabies Likelihood to Succeed and 
Final Advice and the primary interview variabies Intellectual Curiosity and Academic Performance. 

Likeiihood to succeed correiated most strongiy with: 

• Intellectual Curiosity (rho = .65) 

• Academic Performance (rho = .52) 

Final Advice mainiy correiates with: 

• Intellectual Curiosity (rho = .74) 

• Academic Performance (rho = .61 ) 

And to a iesser extent with: 

• Ambition (rho = .49), 

• Self-confidence/Maturity (rho = .46), 

• Contribution to the AUC Community (rho = .45) 
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These outcomes suggest that the interviewer's assessment of the iikeiihood of the student to succeed at ADC and 
his (consequent) finai advice for admission are most strongiy influenced by his assessment of the academic and 
inteiiectuai abiiities of the student. 

As couid be expected, Likelihood to Succeed and Final Advice are strongiy correiated to each other {rho = .78). 

Table 2. Factor analysis (Principal Component Analysis with Varimax Rotation and Kaiser Normalization) on the 
interview scores. 







Rotated Component Matrix 






1 


2 


3 


4 


Academic Performance 


31 








Intellectual Curiosity 


JA 


.34 


.13 


.13 


Communication Skills 


.23 


.21 






Self-confidence /Maturity 


.13 




.40 


.11 


Ambition 


.30 


33 




.11 


Contribution to AUC Community 


.26 


.18 






International Orientation 






JA 


.53 


Likelihood to Succeed 


13 


.35 


.11 


.34 


Final Advice 


J3 


.36 


.22 


.23 



Note: Only factor loadings higher that .Ware shown. 

The pairing of primary interview variabies based on the correiation matrix seems to be confirmed by a four- 
component factor anaiysis. Tabie 2 shows the four rotated components and the factor ioadings for every interview 
variabie, which account for 80% of the variance. The highest factor ioadings of each variabie are underiined to 
indicate the dominant factor for that variabie. 

Factor 1 comprises mainiy: 

• Academic Performance 

• Intellectual Curiosity 

Factor 2 covers mainiy: 

• Self-confidence 

• Ambition 

Factor 3 contains primariiy: 

• Communication Skills 

• International Orientation 

Factor 4 consists mainiy of: 

• Contribution to A UC Community 

• International Orientation 

The factor anaiysis shows that Likelihood to Succeed and Final Advice ioad highest on Factor 1, which confirms that 
interviewers base their assessment of the iikeiihood of the student to succeed at AUC and his (consequent) finai 
advice for admission mainiy on the (perceived) academic and inteiiectuai abiiities of the candidate. Other factors are 
aiso taken into account, but to a much iesser extent (<50% of the factor ioad on factor 1). 
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As our first research question focuses on how exceiience (study success) can be predicted, the next section wiii iook 
into the reiationship between secondary schooi resuits and the scores on interview variabies and the actuai study 
success of the students in their first year at AUC. 



MEASURES OF STUDY SUCCESS. 

As stated before, study success can be understood as both iearning efficiency and effectiveness, expressed and 
measured in terms of: 

• Study progress: the number of credit points a student has obtained (ECP, European Credit Pointsf'^] and 

• Study performance: the grades the student has achieved (GPA, Grade Point Average). 

Finai measures of study success, i.e. time to degree and compietion rate cannot be assessed at AUC as yet. 

These measures depend of course to some extent on the design of the curricuium. it shouid therefore be noted that if 
a student faiis a course at AUC, he/she does not get the opportunity to take a re-exam the same year, if one (or 
more) course is faiied, the student wiii be addressed by the tutor to arrange an agreement to continue on probation, if 
a student faiis too many courses, that can be a ground for expuision. As a consequence of this poiicy, students are 
expected not to faii behind to a iarge extent. On the other hand, students who can’t keep up might ieave AUC sooner 
compared to programmes that aiiow students to study at their own pace. As an effect of this, the variance in the 
number of credit points earned is reduced. 

The AUC’s first year’s curricuium principaiiy consists of 10 courses of each 6 ECP (60 in totai a year in accordance to 
the European Credit Transfer Scheme, ECTS). However, students who have a GPA of 3.0 or higher and who are not 
on probation, have the opportunity to take an 11th course, which a number of students have done. The maximum 
number of credit points obtained by some is therefore 66 ECP. 

On average students who compieted their first year at AUC (165 in totai) earned 572= ECP (51 ECP inciuding drop 
outs) and achieved a GPA of 3.1 , with 64% of them at honours ievei > 3.0, inciuding 30% at cum iaude ievei > 3.5). 

Figure la-b shows the study resuits of those students who have compieted the first year, broken down over 
secondary schooi background. Students who withdrew from AUC, permanentiy or temporary, before the end of the 
year are exciuded from these anaiyses concerning study success^®. Since reasons for withdrawai may vary, neither 
their grades nor obtained credit points, are necessariiy a vaiid reflection of the student’s academic abiiity. Attrition 
(drop out) is further discussed and anaiysed in a speciai section beiow, inciuding a comparison of correiations with 
and without the drop-out students. 




0VWO 

□ IB 

□ Abitur 
0 Other 




Figure 1a. AUC study resuits GPA of the first year, 
for the three iargest secondary school groups (N=159). 



Figure 1b. AUC study results ECP of the first 
year for the three largest secondary school 
groups (N=159) 



Figure la shows that the Abitur and VWO groups appear to perform best on GPA (Effect Size ES = 0.68; Anaiysis of 
Variance: F(3, 155) = 4.9, p < 0.01), as weii as in terms of ECP (Figure 1b, ES = 0.81, F(3, 155) = 6.0, p < 0.01); the 
iB group performs weakest, as weii as the students from other secondary schooi backgrounds. 



it seems that Sciences students wouid yieid the best grade resuits (Figure A7a, ES = 0.39), but this effect is not 
significant (F(3, 155) = 1.3, p > 0.05). Sociai Sciences students seem to obtain the ieast number of credit points 
(Figure A7b, ES = 0.35), but this effect is aiso not significant F(3, 1 55) = 1 .6, p > 0.05). 
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0 Female 
O Male 




Figure 2a. AUC study results GPA of the Figure 2b. AUC study results ECP of the first year, for males 

first year, for males and females (N=159). and females (N=159). 

As shown in Figures 2a and 2b, female students obtain the higher grades than maies (ES = 0.58, F(1, 157) = 12.9, p 
< 0.001), and aiso seem to earn more credit points (ES = 0.30, E(1, 157) = 3.4, p = 0.07). This effect is not entireiy 
attributabie to the differences in secondary schooi grades, as femaie students had oniy siightiy higher secondary 
schooi GPA (ES Vl/l/O = 0.16, E(1, 85) = 0.50, p > 0.4). This is not an uncommon finding in higher education, where 
women appear to be more successfui students than men, a trend that has been observed in various countries over 
the iast decade. 



RELATION BETWEEN STUDY SUCCESS AND ADMISSION VARIABLES: SECONDARY SCHOOL GRADES 
AND STUDY RESULTS AT AUC 

In the following section, the AUC students’ study success, in terms of GPA and ECP, will be analysed against their 
secondary school grades. First, the correlations between them will be presented, followed by a scatterplot for the 
VWO group. 

Table 3a. Correlations (Pearson product-moment correlation coefficient r) between GPA at AUC and the Secondary 
School GPA of the VWO, IB and Abitur groups. 



Secondary 




SS GPA 


Grade 


Grade 


School 




Maths 


English 


VWO 


(N = 87) 


.70** 


.57** 


.35** 


IB 


(N = 2^) 


.47* 


.32 


.43* 


Abitur 


{N=^Q) 


.58* 


.55* 


.43 



*. Correlation is significant at the 0.05 level (2-talled). 

**. Correlation Is significant at the 0.01 level (2-talled). 

Table 3b. Rank correlations (Spearman’s rho) between AUC ECP and Secondary School GPA of the VWO, IB and 
Abitur groups. 



Secondary 




SS GPA 


Grade 


Grade 


School 




Maths 


English 


VWO 


(N = 87} 


.47** 


.47** 


.12 


iB 


(N = 2^) 


.22 


.25 


.12 


Abitur 


{N=^6) 


.27 


.26 


.33 



*. Correlation Is significant at the 0.05 level (2-talled). 

**. Correlation Is significant at the 0.01 level (2-talled). 

As it appears from Tabie 3a, there is a reiativeiy strong correiation between secondary schooi grades and study 
resuits in terms of GPA: the three iargest groups of secondary schooi type aii show positive correiations. For the 
VWO group, secondary school GPA even account for about 50% (r = .70, r^ = .49) of the variance in grades. This is 
very high, compared to other studies after the reiation between secondary schooi grades and academic grades^^. 
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Also the secondary school Maths grade seems to have a strong relation with the grades at ADC (VWO: r = .57) and 
even SS Grade English correlates reasonably with AUC GPA (VWO: r= .35). 

Other secondary school backgrounds, IB and Abitur, show somewhat comparable, reasonably strong correlations 
between SS grades and AUC grades, although not all correlations reach significance, probably related to a low 
number of observations. Overall, averaging all grades, as reflected in the secondary school GPA, seems the best 
predictor of AUC grades (GPA). 

Although using different correlation coefficients (Pearson product-moment correlation coefficient for GPA and 
Spearman’s rank correlation for ECP), it seems that the relation between secondary school grades and ECP at AUC 
is less strong than the relation with AUC grades, but still relatively strong, compared to other studies (e.g. rho = .47 - 
VWO, see Table 3b). (For IB and Abitur, the number of observations are probably too low to produce significant 
correlations). For study progress, measured by credit points, SS Maths grade seems to be an equally good predictor 
as SS GPA. 

It seems that (secondary school) grades predict (study) grades better than they predict progress (credit points), but it 
might also be that the lower correlation with credit points is related to a restriction of the range of values in ECP, 
caused by the already mentioned probation policy at AUC: if students are given the opportunity to study at their own 
pace, lower values of ECP would occur. And if students would be given the opportunity to take re-exams, one might 
also expect less low GPA values to occur, restricting the correlations of secondary school grades with GPA, 
explaining lower correlations found in regular programmes. 
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Figure 3a. Scatterplot of the relations between 
Secondary School GPA and AUC GPA of the Vl/l/O 
group. (N=87) 



Figure 3b. Scatterplot of the relations between 
Secondary School GPA and AUC ECP of the VWO 
group. (N=87) 



The relationship between secondary school average grades {SS.GPA) and AUC average grades {GPA.AUC) of the 
VWC group {r = .70) is plotted in Figure 3a. The linear relation seems apparent in this figure, although the linear 
elliptical shape of the cloud seems to be more pronounced at the higher end of the GPA.AUC distribution, which 
might suggest that (high) secondary school grades are a better predictor for higher undergraduate grades than for 
lower ones. 



The relation between SS.GPA (VWC) and ECP.AUC {rho = .47) is shown in Figure 3b. Note that the highest number 
of credit points (66 ECP) only could be obtained by students with AUC GPA of 3.0 or higher, and who are not on 
probation, which might inflate these correlations to a certain extent. 

The above mentioned correlations are calculated excluding those students who interrupted with their study before the 
end of the year (permanently or temporarily). If these students were included, the correlations between secondary 
school grades and GPA and ECP at AUC would be r = .59 and rho = .41 , respectively, for the VWC group. However, 
these correlations would mean less, since the reasons for drop-out, being not all related to academic ability, add 
noise to these numbers. As a result, grades, and particularly credit points, of these students are incomparable. The 
relation between attrition and predictors like secondary school grades and interview scores is discussed in the 
section on withdrawal below. 
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RELATION BETWEEN STUDY SUCCESS AND ADMISSION VARIABLES: INTERVIEW SCORES 

Table 4. Rank correlations (Spearman’s rho) between the interview scores and GPA and ECP (N = 159). 



Interview variable 


GPA 


ECP 


Academic Performance 


.55** 


.38** 


Intellectual Curiosity 


.21** 


.14 


Communication Skills 


-.04 


-.19* 


Self-confidence / Maturity 


.15 


.01 


Ambition 


.11 


.13 


Contribution to AUC Community 


IT* 


.15 


International Orientation 


.02 


-.07 


Likelihood to Succeed 


.28** 


.17* 


Final Advice 


.33** 


.19* 



*. Correlation is significant at the 0.05 level (2-tailed). 
**. Correlation is significant at the 0.01 level (2-tailed). 



Table 4 shows that from the interview variabies the interviewer's judgement on Academic Performance, i.e. how weii 
the student wouid perform academicaiiy, correiates the highest of aii interview variabies with the academic grades 
and credits, even more than the interviewer's estimation whether the student wouid be iikeiy to succeed and his/her 
finai advice for admission. Though, as we wiii see in the iinear regression modei in the foiiowing section, Academic 
Performance does not add much to the secondary schooi grades, on which it is based. Other variabies, such as 
Intellectual Curiosity and Contribution to the AUC Community aiso seem to correiate moderateiy with study resuits at 
AUC. 

These correiations might be restricted to some extent by the eariier mentioned ‘ceiiing effect', caused by the fact that 
the interview scores of those students who have been admitted are expected to iie at the high end of the scaie. 
Nevertheiess, there seems to be enough variance in interview scores to produce some substantiai correiations, 
particuiariy with Academic Performance. 



PREDICTIVE LINEAR MODEL OF STUDY SUCCESS 

To come to an overall model of prediction of study results at AUC, the predictive variables of secondary school 
grades and interview scores were put into a Multivariate General Linear Model. The most simple linear model would 
be to include only the secondary school GPA, since they have the highest correlation with study success, i.e. is 
solely the best predictor. This simple model may be improved by adding the SS Maths and English grades, to allow 
for different weighing of these secondary school subjects. For the VWO group, a further optimalization of the 
explained variance may be sought after by adding the course profile and the kind of mathematics to the model to 
distinguish between kind and level of subjects. 

Further optimalization is investigated by adding different combinations of interview variables to the model. The added 
value of this extension is discussed below. The results of the Multivariate GLM for the VWO group are stated in Table 
5 (Tables for VWO, IB and Abitur are shown in Appendix B, Table Bla, Bib and Bic. The proportion explained 
variance is expressed by Multiple R^{R^)\ the Adjusted Multiple R^ [R^ adj.) is used to correct for the chance effect of 
adding more variables to the model. 

Summarizing the different models with their predictive variables: 

Model 0: Secondary school GPA 

Model 1 : SS GPA + Grade Math + Grade English (= SS grades) 

Model 2a: SS grades + Course Profile 
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SS grades + Course Profile + Maths Kind (= SS grades*, ‘extended’) 

SS grades* + Interview Final Advice 
SS grades* + Interview Academic Performance 

SS grades* + Interview Factor 1 (Academic Performance + Intellectual Curiosity) 

SS grades* + Interview Factor 2 (Ambition + Self-confidence /Maturity) 

SS grades* + Interview Factor 1 (Academic Performance + Intellectual Curiosity) + Factor 2 (Ambition + 
Self-confidence /Maturity) 

Table 5. Explained variance Multiple and Adjusted Multiple for different models of prediction of CPA and ECP 
for the \/W0 group. 



MOOei ZD 

Model 3a 
Model 3b 
Model 3c: 
Model 3d 
Model 3e 



Predictive Modei 




GPA 




ECP 




Simple 




R2 


R2 adj 


R2 


R2 adj 


Modei 0 


SS GPA 


.49 


.49 


.22 


.21 


Modei 1 


SS GPA, Maths, English 


.50 


.49 


.26 


.24 


Modei 2a 


SS grades + course profile 


.55 


.51 


.38 


.32 


Modei 2b 


SS grades + course profile + maths kind 


.58 


.52 


.41 


.33 


Modei 3a 


SS grades* + Interview FADV 


.58 


.52 


.41 


.33 


Modei 3b 


SS grades* + interview ACPF 


.58 


.51 


.41 


.33 


Modei 3c 


SS grades* + Factor 1 


.58 


.51 


.41 


.32 


Modei 3d 


SS grades* + Factor 2 


.61 


.54 


.41 


.32 


Modei 3e 
Complex 


SS grades* + Factor 1+Factor 2 


.61 


.53 


.41 


.30 



The following summary concerns the results of the predictive model for the VWO group: 

• Secondary School grades: 

o As is displayed in Tabie 5, Modei 0, the simpiest modei, containing oniy SS GPA, accounts for 
approximateiy 50% of the variance in the criterion variabies (academic resuits): R^ = 0.49, R^ adj. = 0.49. 

o Differentiating between Mathematics and Engiish (Modei 1) oniy adds siightiy to the prediction strength [R^ 
= 0.50), but corrected for the chance effect of adding two extra variabies to the modei, this is no reai 
improvement (R^ adj. = 0.49). 

o Adding Course profile and Math level contributes to the proportion expiained variance: (Modei 2a: R^ = 
0.55, R2 adj. = 0.51; Modei 2b: R^ = 0.58, R^ adj. = 0.52). 

• Interview scores: 

o Adding the interviewers estimation of the Final Advice for admission does not seem to add to the predictive 
strength (Modei 3a, R^ = 0.58, R^ adj. = 0.52). 

o Repiacing Final Advice with the interview variabie highest correiating with study success. Academic 
Performance, to the modei does not improve the predictive strength of the modei either (Modei 3b, R^ = 
0.58, R2 adj. = 0.51). Apparentiy, the Academic Performance interview variabie does not provide additionai 
vaiue to the ‘academic performance' estimation of the SS grades (which seems obvious). 

o Adding Intellectual Curiosity to compiete Factor 1 in the modei, does not heip either (Modei 3c, R^ = 0.58, 
R2adj. = 0.51). 

o When repiacing the other interview variabies with Factor 2 interview variabies Ambition and Self-confidence 
/Maturity, the modei expiains 61% of the variance in GPA (Modei 3c, R^ = 0.61, R^adj. = 0.54), the highest 
amount of expiained variance so far. it appears that this factor of interview variabies does have added, 
aithough iimited, vaiue over the secondary schooi grades. 

o Adding the Factor 1 variabies Academic Performance and Intellectual Curiosity does not gain more 
predictive strength (Modei 5, R^ = 0.61 , R^ adj. = 0.53). 

in conciusion: the most simpie predictive modei accounts for 50% proportion expiained variance, the most compiex 
modei adds about another 11% to a totai of 61%. However, when correcting for the addition of variabies, the surpius 
of the compiex modei is a mere 4% (Modei 3e: R^ adj. = 0.53 against Modei 0: R^ adj. = 0.49). 

When appiied to the data of the iB and Abitur groups (see Appendix B, Tabies Bib and Bic), it seems that a 
comparabie predictive iinear modei may be justified to expiain more or iess comparabie amounts of variance in the 
AUC academic resuits, aithough there seem to be differences in, for instance, the even greater added vaiue with the 
iB students for course profile (for the iB group particuiariy level of English) and kind and level of maths, and the 
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interviewer’s assessment of the applicants Academic Performance. With the Abitur group, Maths and English grades 
seem to provide added vaiue, as weii as the Factor 2 interview variabies, which resembies the VWO group. 

However, the resuits of iB and Abitur groups shouid be regarded with caution, as the number of students in these 
groups are smaii, which enhances chance capitaiization effects for modeis with increasing numbers of parameters to 
be estimated - as is reflected in the decreasing Adjusted Multiple R^. The predictive power of the admission 
variabies, and differences therein for the various secondary schooi backgrounds, may be investigated further in 
research on future cohorts of students at AUC. 



STUDENT WITHDRAWAL / ATTRITION 

Students may discontinue their study programme for various reasons. Of the totai 189 students who have started the 
first AUC year in September, 24 (13%) have ieft before or at the end of the year, 165 (87%) compieted the first year 
successfuiiy. 

Aithough it seems that students ieave for a mix of reasons, the main categories seem to be: 

• reiated to academic performance: student was expeiied or 

• voiuntariiy ieft because of iacking academic resuits; 

• reiated to course and programme content: wish to pursue another course or career; or 

• unreiated to performance or content: personai reasons, heaith reiated or unknown. 

These different reasons for ieaving, distributed over the three iargest secondary schooi groups, are depicted in 
Figure A8. As shown in this figure, various reasons for interrupting the study programme are found in the different 
secondary schooi groups. The reiative number of IB students who left or were expelled appear to be the highest 
among the school groups. 

When results are lacking, it may be that the student's ability fell short to complete the study, or his or her motivation 
was lacking to put the effort into it. In that case, it is often difficult to tell which way the causal relation goes: were the 
results low because the motivation was lacking of was the motivation waning caused by disappointing study results? 
To gain insight in the intertwining relation between stated exit reasons and academic ability, we investigated the 
relation between exit reasons and GPA at AUC: CPA < 2.7, CPA > 2.7. 

This very small scale investigation shows that the performance related exit reasons, expelled and left for academic 
results, seem indeed to be related to GPA results lower than 2.7, as was to be expected. Students who left before 
and thus without obtaining any grades have various reasons to do so, related or not to programme content. Students 
who left with high grades (GPA > 2.7) seem not to be driven away by the programme content, but state personal 
reasons for departure. These numbers are too small to reach reliable conclusions, but this first categorization proves 
useful, to develop more insight into why students leave the programme. This analysis will continue be applied to 
future cohorts. 

To explore the predictability of drop-out, the relation between secondary school GPA and exit reasons was examined 
more closely, by comparing the rank percentages of SS GPA per exit category with those of the total group. 

From this comparison, it appears that in the VWO group, performance related drop outs {expelled and left because of 
academic results) show quite low rank percentile numbers on SS GPA, which seems to confirm the relationship 
between low SS GPA and low GPA at AUC. In other words: not only for the students who stayed at AUC (see Table 
3a), but also for the students who left because of lacking academic performance, there seems to be a relation 
between SS GPA and GPA at AUC. In the content-related and performance-unrelated exit reason groups, SS GPA 
do not seem to be that low, compared to the average of the total group, indicating that SS GPA does not signal a 
possible risk of drop-out in categories other than those related to academic performance. Also this was to be 
expected. 

With a view to a broader application of selective admission on the basis of secondary school grades, it is important to 
understand the predictability of drop out better than the current data provide for. Small scale statistical modelling 
suggests that rejecting the student with the lowest SS GPA of every group VWG, IB and Abitur, would not have 
reduced the total number of students who have successfully completed the first year, as all these students have 
dropped out (although not all for straightforward academic reasons). When discarding the lowest three of each group, 
of the nine rejected students, five have dropped out (again, not all for straightforward performance related reasons). 
It seems, that if SS GPA criteria for admission would have been sharpened, as to reject VWO students with GPA 6.0 
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or lower, IB students with GPA under 4.0 and Abitur students under 8.0, these five students wouid have been 
rejected without reducing the totai number of students who wouid have successfuiiy compieted the first year. 

From this statisticai experiment it seems that secondary schooi grades provide a signaiiing function in predicting oniy 
for part of the drop-out. When used to increase admission standards, one shouid, however, account for those 
students who wouid be unrightfuiiy rejected, as some of them might have been abie to succeed with the study. 

When iooking at the interview scores of the students who dropped out, it appears that their academic performance as 
assessed by the interviewers might indicate a risk for getting expeiied, since the interview score on that dimension 
seems fairiy iow. On the other hand, this does not easiiy yieid a usefui seiection instrument, since many students faii 
in the same iowest range of scores have successfuiiy finished the first year. 

More preciseiy, it appears that when having discarded aii students with Academic Performance interview score of 2 
or iower, 51 students wouid not have been admitted, of which 9 indeed have dropped out (aithough not aii for 
straightforward performance reiated reasons): 4 are expeiied, 1 ieft for academic reasons, 2 for content-reiated 
reasons and 2 for personai reasons. 42 wouid have been denied access who have successfuiiy compieted the year, 
in other words, for every rightfuiiy rejected appiicant on this criterion, at ieast four wouid have been unrightfuiiy 
rejected. 

Again, in the examined cohort of students, the drop-out numbers are too smaii for robust statisticai anaiysis on 
muitipie dimensions. The presented findings oniy indicate questions and issues that need to be foiiowed up in further 
research. 



CONCLUSIONS AND DISCUSSION 

This research contributes to the deveiopment of an evidence-based method of seiection for admission to 
undergraduate university education that is based on predictive indicators of study success, and with the purpose of 
promoting exceiience and diversity. The research questions addressed is how exceiience (study success) in 
undergraduate university education can be predicted. More preciseiy, which factors addressed in the admission 
process expiain most variance in study progress and performance and to what extent these factors vary in reiation to 
the diversity of students' backgrounds. 

The data presented above present a preiiminary anaiysis of resuits on the first year of the first ciass of Amsterdam 
University Coiiege. Consequentiy, iimitations of such a first measurement shouid be taken into account in interpreting 
the resuits and generaiizing these to a wider context. 

in summary to these preiiminary resuits point out that: 

• AUC is achieving exceiience in terms of study progress (57 ECP on average obtained per student in the first 
year for those who successfuiiy compieted the first year and 51 on average inciuding drop outs) and 
performance (GPA of 3.1 for those who successfuiiy compieted, with 64% at honours ievei > 3.0, inciuding 30% 
at cum iaude ievei s 3.5), and an attrition rate of oniy 13%. 

• Diversity occurs with respect to secondary schooi background: Dutch VWO & German Abitur students perform 
on average stronger than IB students and students from other secondary school backgrounds. Female students 
perform on average better than male. 

• Predicting excellence seems to focus on variables related to prior academic achievement (as measured for 
secondary school GPA. Strongest correlations were found between Secondary School GPA and GPA at AUC 
(.70 for VWO, .58 for Abitur and .47 for IB) and between Secondary School GPA and ECP obtained at AUC (.47 
for VWO, .27 for Abitur and .22 for IB). 

• After an initial assessment of secondary school records and accompanying documents, a selection of potential 
students is invited for an interview. It seems that the interviewers also strongly focus on academic performance, 
since the interviewer’s assessment of the likelihood of the student to succeed at AUC and his (consequent) final 
advice for admission are most strongly correlated with his assessment of the academic and intellectual abilities 
of the student (.60 - .70). Other factors, such as ambition, self confidence, contribution to the AUC community, 
communication skills, and international orientation, are also taken into account, but to a much lesser extent. 

• Accordingly, the interviewers assessment of academic performance is the interview score with the highest 
correlation to both GPA (.55) and ECP (.38). In other words, other than academic performance related variables 
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or the interviewer's score based on that, contribute iittie to the expiained variance and thus to the predictabiiity 
of exceiience in terms of study success. 

• Secondary schooi GPA aiso appears to predict attrition better than interview scores (even on singie score for 
academic performance), as the former more preciseiy discriminate between successfui students and drop outs 
than the iatter. 

The correiations found between secondary schooi GPA and GPA and ECP at AUC are stronger than those found in 
previous Dutch research on the predictive strength of secondary schooi grades for study success in university. The 
first reason for this may be that prior studies usuaiiy take study success in university over at ieast three years into 
account, with in generai a deciining correiation between SS GPA and study success over the subsequent years, in 
this study oniy the first year resuits are measured and it can be expected that aiso here the reiationship wiii weaken 
over time, ieading to more modest correiations between SS GPA and study success in the totai undergraduate 
period. 

A second reason may be that the difference between the correiations found for GPA wouid be expiained by the fact 
that AUC does not aiiow students to take re-exams, as reguiar university programmes in the Netheriands usuaiiy do. 
Consequentiy, the range of grades at AUC is iarger and affects the correiation score positiveiy. in the same fashion 
one can assume that context, or the way in which the study programme is organised, aiso affects the number of 
ECPs obtained. Ruies and reguiations regarding faiiing a course are much stricter at AUC than in reguiar 
programmes. 

The roie of context impiies that students with the same abiiities wouid not necessariiy demonstrate the same study 
success in a reguiar study programme, in order to test to what extent the predictive vaiue of the indicators is 
contingent on context, a group of students with simiiar secondary schooi GPAs needs to be examined in terms of 
their university GPA and ECP in the first year of a reguiar programme. 

Aithough course profiie and (reiated to that) the ievei and kind of mathematics add oniy moderateiy to the expiained 
variance by secondary schooi GPA as a whoie, student faiiure in a range of compuisory courses in the first year 
turned out to be strongiy connected with their secondary schooi grade on mathematics. Consequentiy, admission 
requirements for mathematics have been enhanced (from a 7 to an 8 on the Dutch 10-point scaie). The ciass of 2013 
reflects an average math score of 7.8 in comparison to 7.1 for the ciass of 2012. And their overaii GPA rose from 7.3 
to 7.7. The continuation of this research wiii point out more preciseiy how much the difference in mathematic abiiity 
affect and expiain study success. 

Given the dominant predictive vaiue of prior academic performance (SS GPA), the eariier mentioned ‘merit’ modei 
(Drenth, 2004) seems preferabie, even more so since this is more under the controi of the students and encourages 
their effort at secondary schooi. 

The question is whether interviews generate sufficient added vaiue (in particuiar with regard to the time and costs of 
this modei) and the risk, as set out in the first part of this paper, on subjective interpretations of in particuiar “soft 
variabies”. interviewers need to be constantiy aware of this since AUC's objective is to combine exceiience and 
diversity (i.e. of the risk to jeopardise equity in access). 

At this stage, the answer seems to be that interviews provide extra guidance to both the student and the institution as 
to whether the student is choosing the right study programme (and not so much as whether he is abie to compiete it 
successfuiiy). 

Consequentiy, the combined modei of seiection on the basis of prior academic achievement at secondary schooi 
(GPA) and personai interviews wiii be continued. However, specific attention needs to be paid to the fact that the 
interviewer's estimate of academic performance seems to be iess accurate to predict study success than the actuai 
secondary schooi GPA (i.e. based on the formed more students couid have been wrongiy rejected than on the basis 
of the iatter). 

At the same time, aiternative measures to ensure informed and conscious study choice couid be considered. 

Finaiiy the next phase of this study wiii need to address diversity of the student body in terms of their socio-economic 
background and a range of reiated variabies. 
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Appendix A. Figures. 
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Figure A1. Distribution of students over secondary school types. 
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Figure A2a. Distribution of students with VWO 
background over course profiles. 



Figure A2b. Distribution of students with VWO background 
over kinds of maths taken at secondary education. 
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Figure A3. Preferred (intended) majors at the admission stage, distributed over gender. 
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Figure A4. Preferred (intended) majors at the admission stage, distributed over secondary school background. 
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standard deviations are displayed as vertical lines through the mean. 

Figure A6a. Mean scores and standard deviations of the interview variables, distributed over secondary school 
background. 
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□ VWO(N= 14^ 

□ IB (N=5S) 
HAbitur(N=32) 

□ Other (N=72) 
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Standard deviations are displayed as vertical lines through the mean. 

Figure A6b. Mean scores and standard deviations of the interviewer’s Final Advice, distributed over secondary 
school background. 
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Figure Ala. AUC study results GPA of the first year, Figure Alb. AUC study results ECP of the first year, 

distributed over the majors. distributed over the majors. 
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Figure A8. Exit reasons by secondary school background. 
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Appendix B. Tables. 

Table Ala. Explained variance Multiple and Adjusted Multiple for different models of prediction of GPA and 
ECP for the V14/0 group. 



Predictive Modei 




GPA 




ECP 




Simple 




R2 


R2 adj 


R2 


R2 adj 


Modei 0 


SS GPA 


.49 


.49 


.22 


.21 


Modei 1 


SS GPA, Maths, English 


.50 


.49 


.26 


.24 


Modei 2a 


SS grades + course profile 


.55 


.51 


.38 


.32 


Modei 2b 


SS grades + course profile + maths kind 


.58 


.52 


.41 


.33 


Modei 3a 


SS grades* + interview FADV 


.58 


.52 


.41 


.33 


Modei 3b 


SS grades* + interview ACPF 


.58 


.51 


.41 


.33 


Modei 3c 


SS grades* + Factor 1 


.58 


.51 


.41 


.32 


Modei 3d 


SS grades* + Factor 2 


.61 


.54 


.41 


.32 


Modei 3e 
Complex 


SS grades* + Factor 1+Factor 2 


.61 


.53 


.41 


.30 



Table A1b. Explained variance Multiple R^ and Adjusted Multiple R^ for different models of prediction of GPA and 
ECP for the IB group. 



Predictive Modei 




GPA 




ECP 




Simple 




R2 


R2 adj 


R2 


R2 adj 


Modei 0 


SS GPA 


.22 


.18 


.05 


.00 


Modei 1 


SS GPA, Maths, English 


.29 


.16 


.07 


-.10 


Modei 2a 


SS grades + course profile 


.41 


.09 


.35 


.00 


Modei 2b 


SS grades + course profile + maths kind 


.61 


.21 


.56 


.13 


Modei 3a 


SS grades* + interview FADV 


.62 


.15 


.57 


.05 


Modei 3b 


SS grades* + interview ACPF 


.71 


.35 


.70 


.34 


Modei 3c 


SS grades* + Factor 1” 


.71 


.28 


.70 


.26 


Modei 3d 


SS grades* + Factor 2 


.61 


.02 


.58 


-.05 


Modei 3e 
Complex 


SS grades* + Factor 1+Factor 2 


.73 


.11 


.72 


.08 



Table Ale. Explained variance Multiple R^ and Adjusted Multiple R^ for different models of prediction of GPA and 
ECP for the Abitur group. 



Predictive Modei 




GPA 




ECP 




Simple 




R2 


R2 adj 


R2 


R2 adj 


Modei 0 


SS GPA 


.34 


.29 


.09 


.03 


Modei 1 


SS GPA, Maths, English 


.57 


.46 


.40 


.24 


Modei 3a 


SS grades* + interview FADV 


.60 


.44 


.41 


.17 


Modei 3b 


SS grades* + interview ACPF 


.58 


.41 


.43 


.20 


Modei 3c 


SS grades* +Factor 1 


.63 


.42 


.56 


.31 


Modei 3d 


SS grades* + Factor 2 


.79 


.68 


.69 


.52 


Modei 3e 
Complex 


SS grades* + Factor 1+Factor 2 


.81 


.62 


.77 


.55 
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' Christoffel Reumer is a researcher at AUC and a PhD student at the VU University Amsterdam. Marijk van der Wende is the 
Dean of AUC and Professor of Higher Education and PhD supervisor at the VU University Amsterdam. 

2 This refers to the Caiifornian Masterplan (1960), which had as two underlying principles: higher education ought to be accessible 
to all people, regardless of their economic position, and function of higher education should be differentiated in three separate 
systems (i.e. the research universities granting degrees up to the doctoral level and carrying out research, the state universities 
granting degrees up to masters level, and the community colleges) that would strive for excellence in different areas to enhance 
efficiency. In this way, Clark Kerr, one of the principle architects of the Plan, expressed his goal to balance the competing 
demands of fostering excellence and guaranteeing educational access for ait. The Californian Masterplan played an important role 
as a model for restructuring public higher education in the US and beyond (Rothblatt, 1992). In the Netherlands the Californian 
Model was already discussed in the 1980s as a model for reform (Rupp, 1997). 

2 See: http://www.u-map.eu/ 

A “liberal arts” institution can be defined as a “college or university curriculum aimed at imparting general knowledge and 
developing general intellectual capacities, in contrast to a professional, vocational, or technical curriculum.” (Encyclopedia 
Brittannica). The Carnegie Classification identifies Baccalaureate Colleges - Liberal Arts as institutions that “are primarily 
undergraduate colleges with major emphasis on baccalaureate programs and which award at least half of their baccalaureate 
degrees in liberal arts fields” (Carnegie Foundation for the Advancement of Teaching website). The term “liberal arts” or “liberal 
education” is often used as a short hand for the more comprehensive term “liberal arts and sciences education”, although it is 
explicitly recognized that the sciences have their integral place in that concept. 

® “Almost total” as there are certainly exceptions. Firstly of course the UK with a by and large selective system of admission to the 
universities, with stratified levels of admission and Oxbridge global brand name elite institutions (Tapper & Palfreyman, 2009). But 
also the Grandes Ecoles in France, and other selective branches of European higher education like schools of fine and performing 
arts, hotel schools, business schools, some military academies, etc. For Germany a turning point seems to appear with the recent 
launch of its “excellence initiative”, although this is mostly focusing on research (Kehm & Pasternack, 2009). 

® The term “university college” is used in the Netherlands for selective liberal arts colleges and is not to be confused with the use 
of the same term in some other countries (e.g. Norway or Belgium) as the international name for non-university type of institutions. 
2 In addition, programs labeled as liberal arts were opened on Utrecht's main campus, in the University of Amsterdam and in 
Tilburg University in the same period (these can be considered as broader or less straightforward interpretations of the liberal arts 
college model, are not all taught in English and not necessarily residential). 

® Observations on the historical accuracy of this point vary. Douglass for instance argues that the big three were already 
discriminating before 1920 and did not simply base admissions on "academic criteria". A big share of Harvard's entering class 
before and after 1920 was based on alumni and family connections - still does this today with about 20% or more children of 
alumni getting preferential treatment. But they stepped up considerably their attempt to keep out the undesirables in the 1920s by 
getting more info - like pictures of the applicants (Douglass, 2007: 50-55 and 257-258). 

’ For example, see the following sources for an detail on criteria used for determining eligibility and then selection of student at UC 
Berkeley: http://students.berkelev.edu/admissions/ 

A new study indicates that at private elite colleges and universities in the US: “The relative advantage of being an alumni child 
has gone up rapidly in the last 20 years. In 2009, Princeton admitted 41.7 percent of "legacy" applicants (alumni children), 4.5 
times the rate for non-legacies. In 1992, the legacy admit rate was only 2.8 times the rate for others” 

( http://www.insidehiahered.eom/news/2010/09/22/leaacv ). 

The specification “cumulative” does as such not contradict the Dutch findings on the predictive value of “final” GPA as the final 
grades in the Dutch system are a combination of cumulative GPA over the last three years of secondary education and the grades 
for school-based and national examinations. 

'2 Such as the widely-used SAT (Scholastic Aptitude Test) in the USA. 

'3 VWO = Voorbereidend Wetenschappelijk Onderwijs, or University Preparatory Education, which takes six years and qualifies 
students for entry to university education. See For more information on the Dutch educational system,: 

http://www.nuffic.nl/international-students/dutch-education/education-svstem . 

See: http://www.auc.nl/acadproa/obiect.cfm/434F556F-1321-B0BE-A4EAC2FF829B908B 
'3 For more information on AUC in general see: www.auc.nl . For details on its admission procedure and criteria see: 
http://www.auc.nl/admissions/obiect.cfm/52555E6D-1321-B0BE-A49A96664670A64A 

'3 For instance international and IB schools provide a detailed explanation of the individual student's score compared to the class 
average and the average of the school over a number of years. French testimonials give such a systematic comparison of the 
scores of pupils in relation to the class average and the deviation from the highest and lowest scores per class. Schools in the 
U.S. often show explicitly whether or not they grade to the curve. The information provided by the Dutch VWO schools is in 
comparison with these international examples extremely minimal. 

'2 Several cases occurred and were mostly related to serious illness of the student or (loss) of an immediate family member or an 
intensive sport or artistic career. Therefore substantially less time than normally available was spent on schoolwork and 
consequently grades were lower than under normal circumstances would have been expected. 

'3 See: http://www.auc.nl/admissions/obiect.cfm/52555E6D-1321-B0BE-A49A96664670A64A 
'3 Ibid. 

23 In Februari 2010, another 14 students joined. These students are not included in the analyses in this article, since they have not 
yet completed a full year of study at this point. 

21 Inquiry at the most recent data show that a number of the Abitur students actually declared their major in the Sciences after the 
first year, levelling the proportions to some extent. 

22 In the case the interview was carried out by two interviewers, the interview scores are averaged. 
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23 Although ‘3’ was the maximum score of the 3-polnts scale, some Interviewers occasionally chose to give scores higher than 3, 
e.g. ‘3+’, which was entered In the database as 3.25. Of course, this effects not only mean scores, but also the standard 
deviations. 

2'* Study progress is mainly reflected in ECP, but partly also in GPA, because course failure is graded with grade point 0.0. 

23 Including credits earned in extra (fifth) courses. 

23 6 students were excluded from the analyses for reason of temporary withdrawal (illness) and 9 out of 24 drop outs (see section 
on attrition) did so because of academic performance. 

22 For instance, De Gruyter et al. (2006) found a correlation of .58 between the Dutch secondary school GPA and the average 
grade in the first year of a psychology study and a correlation of .56 for a law study at Leiden University. In another study on the 
feasibility of selection in (particularly) medical studies in The Netherlands, the Committee Drenth (1997) speaks of the relation 
between secondary school and study success in the first bachelor year as being ‘moderate’, mentioning a correlation of .32. After 
the first year, this correlation drops to .10 towards the end of the study (6 years). 
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